Quantum random walks with history dependence 
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We introduce a multi-coin discrete quantum random walk where the amplitude for a coin flip 
depends upon previous tosses. Although the corresponding classical random walk is unbiased, a 
bias can be introduced into the quantum walk by varying the history dependence. By mixing the 
biased random walk with an unbiased one, the direction of the bias can be reversed leading to a 
new quantum version of Parrondo's paradox. 
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I. INTRODUCTION 



Random walks have long been a powerful tool in mathematics, have a number of applications in theoretical computer 
science P, 01 and form the basis for much computational physics, such as the Monte Carlo simulations. The recent 
flourish of interest in quantum computation and quantum information l3,l4 | has lead to a number of studies of quantum 
T— I , random walks both in continuous [110 and in discrete time IS lol flCt Meyer has shown that a discrete time, 
' discrete space, quantum random walk requires an additional degree of freedom or quantum "coin," and can be 
\ modeled by a quantum lattice gas automaton 12]. Quantum random walks reveal a number of startling differences to 
• their classical counter parts. In particular, the diffusion on a line is quadratically faster. Quantum random walks show 
promise as a means of implementing quantum algorithms. Childs et al prove that a continuous time quantum 
I ' , . random walk can find its way across some types of graphs exponentially faster than any classical random walk, while 
' a discrete time, coined quantum walk has been shown to equal Grover's algorithm in finding a specific item in an 
^ . unsorted database with a quadratic speedup over the best classical algorithm (1^]. A method of implementing a 
^ ■ quantum random walk in an ion trap computer has been proposed |l5j | . A recent overview of quantum random walks 
is given by Kempe 16]. 

^ ' Parrondo's games or Parrondo's paradox arises where a combination of two losing games result in a winning 
I game 0,0]. Such an effect can occur when one game has a form of feedback, for example, through a dependence on 
. the game state 0] , through the outcomes of previous games ^2d\ , or through the states of neighbors f2lj , that leads to 
■ a negative bias. When this feedback is disrupted by mixing the play with a second losing game that acts as a source 
of noise, a net positive bias may result. The recent attention attracted by classical versions of Parrondo's games is 
motivated by their relation to physical systems such as flashing ratchets or Brownian motors [2^1231 12^ , or systems 
of interacting srans |25j ]. Applications in fields as diverse as population genetics ISj, biogenesis |26l ]. economics and 
biochemistry have been sug gested. Quantum equivalents to Parrondo's games with a pay-off dependence 0] 
or a history dependence |28l l29| have been demonstrated. A link between quantum Parrondo's games and quantum 
algorithms has been discussed |30l Isil ] . Recent reviews of classical and quantum Parrondo's games can be found in 
Refs. '32^ and 'sS], respectively. In this paper we develop a model of a quantum random walk with history dependence 
and detail its main features. We show that this can lead to a new quantum version of Parrondo's paradox. 

The paper is divided as follows. Section |n] gives a brief summary of the classical Parrondo's games and their 
quantum analogs. Sec. IIIII sets out the mathematical formalism of our scheme, Sec. IIVI gives some results for the 
random walk of a single particle on a line with this scheme, while Sec. demonstrates a new quantum Parrondo 
effect. 
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II. PARRONDO'S GAMES 



The original Parrondo's games were cast in the form of a pair of gambhng games, game A the toss of a simple 
biased coin with winning probability p = ^ — e, and game B consisting of two biased coins, the selection of which 
depends upon the state of the game. Coin Bi, with winning probability pi, is selected when the capital is a multiple 
of three, while coin B2, with winning probability p2, is chosen otherwise. Each coin toss results in the gain or loss of 
one unit of capital. With, for example, 

pi = l/10-e, p2-3/4-e, e > 0, (1) 

game B is losing since the "bad" coin Bi is played more often than the one-third of the time that one would naively 
expect. By interspersing plays of games A and B, the probability of selecting Bi approaches |, and that game 
produces a net positive result that can more than offset the small loss from game A, when e is small. The combination 
of the two losing games to form a winning one is the essence of the apparent paradox first described by Parrondo. 

Meyer and Blumer were the first to present a quantum version of this effect. In their model, the quantum 
analog of the capital is the discretization of the position of a particle undergoing Brownian motion in one dimension. 
Each play of the game changes the particle position by ±1 unit in the x direction. The biases of game A and B are 
achieved by the application of potentials 

Va{x) = ax, a > 0, 

1 (2) 

Vb{x)^Va{x) + I3{l--{x iRodS)), /3>0, 

respectively. By adjusting the parameters of the potentials, the quantum games A and B can be made to yield similar 
negative biases to their classical counter parts. When switching between the potentials is introduced, the bias can be 
reversed for certain mixtures of A and B. For the classical and quantum versions, comparisons of the expectations for 
the individual games and an example of a winning combination arc given in Fig. ^ For details of the classical case 
see Harmer and Abbott for the quantum case Meyer and Blumer . 

A history-dependent game can be substituted for the above game B to produce a variant of Parrondo's games. 
Game B consists of four coins whose choice is determined by the results of the previous two games, as indicated in 
Fig. 12 An analysis of this game for 

Pi = 7/10-e, p2=P3 = l/4-e, P4 = 9/10 - e, (3) 

indicates that the game is losing for e > . Mixing this with game A or a different history-dependent game B [s^l 
can yield an overall winning result. A direct quantization of this scheme is given by Flitney et al pflj ]. The quantum 
effects in this model depend upon the selection of a suitable superposition as an initial state. Interference can then 
arise since there may be more than one way of obtaining a particular state. Without interference, this scheme gives 
the same results as the classical history-dependent Parrondo's game. The method presented in the current article 
uses an alternative approach, a discrete quantum random walk or quantum lattice gas automaton. 



III. SCHEME FORMALISM 



A direct translation of a classical discrete random walk into the quantum domain is not possible. If a quantum 
particle moving along a line is updated at each step, in superposition, to the left and right, the global process is 
necessarily non-unitary. However, the addition of a second degree of freedom, the chirality, taking values L and R, 
allows interesting quantum random walks to be constructed. Consider a particle whose position is discretized in one- 
dimension. Let Tip be the Hilbert space of particle positions, spanned by the basis : x G Z}. In each time step 
the particle will move either to the left or right depending on its chirality. Let He be the Hilbert space of chirality, 
or "coin" states, spanned by the orthonormal basis {\L), \R)}. A simple quantum random walk in the Hilbert space 
Ti-p ® Ti-c consists of a quantum mechanical "coin toss," a unitary operation U on the coin state, followed by the 
updating of the position to the left or right: 

E={S®pR + S-^® pL){ip ® U), (4) 

where S is the shift operator in position space, S\x) — \x + 1), Ip is the identity operator in position space, and Pp 
and Pl are projection operators on the coin space with Pp + Pp = Ic, the coin identity operator. For example, a 
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FIG. 1: Mean position {x) as a function of time (in number of coin tosses) for (dashed lines) the classical games A, B and 
the repeated sequence AABB with e — 0.005 in Eq. Q, and (solid lines) the quantum games A, B and the repeated sequence 
AAAAB with a — 7r/2500 and (3 — tt/S in Eq. In the classical case, x is the player's capital with $1 awarded for each 
winning coin toss and -$1 for each losing toss. Here, x is the particle position and we assume full coherence is maintained in 
the quantum case. The difference in payoffs between the classical and quantum examples is due to the particular parameters 
chosen. However, interference in the quantum case produces a greater turn around in x than is obtainable in the classical 
situation. 



results of previous two games 






won, won 




FIG. 2: In the classical history-dependent Parrondo's game B, the selection of coins Bi to B4 depends upon the results of 
the last two plays, as shown. The probabilities of winning (increasing the player's capital by one) are pi to p4 and of losing 
(decreasing the player's capital by one) are 1 — pi to 1 — p4. The overall payoff for a series of games is the player's final capital. 



walk controlled by an unbiased quantum coin is carried out by the transformations 



\x,L) 
\x,R) 



1 

V2 
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V2 



{\x-l,L) + i\x + l,R)), 
{i\x-l,L) + \x + l,R)). 



(5) 



Figure 131 shows the distribution of probability density after 100 steps of Eq. with the initial state jf/'o) = (|0, L) — 
\0,R))/V^ l^^l- This initial state is chosen so that a symmetrical distribution results. In fact the states \0,R) and 
|0, L) evolve independently. We can see this since any flip \R) <-> \L) involves multiplication by a factor of i. Thus, 
any \x, L) state that started from |0, R) will be multiplied by an odd power of i and is orthogonal to any |x, L) state 
that originated from |0,L) (and similarly for the \x,R) states). 

To construct a quantum random walk with history dependence requires an extension of the Hilbert space by 
additional coin states. Where we have a dependence on the last M — 1 results, the total system Hilbert space is a 
direct product between the particle position in one dimension and M coin states: 



(6) 



The M coins represent the results of tosses at times i— 1, t— 2,..., t — M. A single step in the walk consists of tossing 
the Afth coin, updating the position depending on the result of the toss, and then re-ordering the coins so that the 
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FIG. 3: The distribution of probability density P{x) = |?/'(a;)p at toss t — 100 for an unbiased, single coin quantum random 
walk with I^/jq) = -^{\0,L) — \0,R)). Only even positions are plotted since tpi^) is zero for odd x at t — 100. The total area 
under the graph is equal to one. 

newly tossed coin is in the first (most recent) position. In general, the unitary coin operator U can be specified, up 
to an overall phase that is not observable, by three parameters, two of which are phases. In the single coin case the 
effect of the phases can be completely mimicked by changes to \^po) |35j |. This does not carry over to our multi-coin 
history-dependent scheme. However, for the sake of simplicity we shall omit the phases and simply write 

where 1 — p is the classical probability that the coin changes state, with p — being an unbiased coin. To allow for 
history dependence, p will depend upon the results of the last M — 1 coin tosses, so that a single toss is effected by 
the operator 

^= (^^/c^(^-^^®P« + ^-i^/c^(^-^)®Pl) (/P® E Pl..u,-.^U{p,,...,,,_M , (8) 

V ji,...jjf-iG{L,i?,} / 

where Pj, j S {L, R} is the projection operator of the Mth coin onto the state \j) and Pj\...j,^,_;^i jk & {L, R} is the 
projection operator of the first M — 1 coins onto the state |ji . . . jm-i)- The second parenthesised term in ||SJ| flips 
the Mth coin with a parameter p that depends upon the state of the first M — 1 coins, while the first term updates 
the particle position depending on the result of the flip. Re-ordering of the coins is then achieved by 

6 ^ip® ^ I JM ji ■ • • 3M-i) (ji ■ • ■ jM^ljM I ■ (9) 

This scheme is distinguished from Brun et aFs work on quantum walks with multiple coins (361] where the walk is 
carried out by cycling through a given sequence of M coins, U{pi), . . . , U{pm)- In Brun's scheme, a coin toss is 
performed by 

where k = (t mod M), and the step is completed by the O operator as before. The scheme has memory but not the 
dependence on history of the current method. The two schemes are only equivalent when all the pk and Pji...jM-i 
equal, for example, when all the coins are unbiased. This amounts to asserting that the scheme of Brun et al does 
not display Parrondian behavior. 

IV. RESULTS 

The probability density distributions for unbiased 2, 3, and 4 coin history-dependent quantum random walks, with 
initial states that are an equal superposition of the possible coin states antisymmetric as L <-^- i? [s^ are shown in 
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FIG. 4: (Color online) The probability density distributions P{x) = |^(a;)p at toss t — 100, for the 2- (blue), 3- (green) and 
4- (red) coin unbiased, symmetrical, quantum random walks. Only even positions are plotted since ^(a;) is zero for odd x at 
t = 100. The area under each curve is equal to one. 



Fig. 21 These distributions are essentially symmetric versions of the graphs of Brun et al that result from an 
initial state = 

For arbitrary M we have, as for the M = 1 case, two parts of the initial state that evolve without interacting. Thus, 
for M — 2 for example, states arising from \Q,LL) and |0, will interfere, as will states arising from |0, Li?) and 
|0, RL), but the two groups evolve into states that are orthogonal, for any given x. For the M coin quantum random 
walk there are M + 1 peaks with even values of M having a central peak, the others necessarily being symmetrically 
placed around a: = by our choice of initial state. The outer most pair of peaks are in the same position as the peaks 
for M = 1 (Fig. O at x{t) « 0.68i. All the peaks are interference phenomenon, the central one being the easiest to 
understand. It arises since there are states centred on a; = that cycle back to themselves (i.e., that are stationary 
states over a certain time period). With M — 2, the simplest cycle over i = 2 is proportional to 

\0,LR) - \0,RL) ^ ^{\+l,RL) + i\-l,LL) - \-l,LR) - i\+l,RR)) 

V2 (11) 

^ \0,LR) - \0,RL). 

At the second step, complete destructive interference occurs for the states with x = ±2, so that there is no probability 
flux leaving the central three x values. In practice, the central region asymptotically approaches a more complex 
stationary cycle than (|ll|l . such as the t = 2 cycle 

IV'center) « {ai - b){\ - 2, LL) + \ + 2, RR)) + (1 - a - ^ + bi){\ -2,LR) + \ + 2, RL)) 

+ [i - - 2, RL) + \+2,LR)) + {b-at){\0,LL) + \0,RR)) + [a + bi){\0, LR) + \0,RL)), ^ ' 

where a and b are real. 

Adjusting the values of the various p can introduce a bias into the walk. To create a quantum walk analogous to 
the history-dependent game B of Sec.^ requires M = 3, giving four parameters, prr, prl, Plb. and pll- Figure|Sl 
shows the effect of individual variations in these parameters on the expectation value and standard deviation of the 
position after 100 time steps. 



V. QUANTUM PARRONDO EFFECT 



It is useful to consider the classical limit to our quantum scheme. That is, the random walk that would result if the 
scattering amplitudes were replaced by classical probabilities. As an example consider the M = 2 case, with winning 
probabilities 1 — pL and \ — pR. The analysis below follows that of Harmer and Abbott [s^l- Markov chain methods 
cannot be used directly because of the history dependence of the scheme. If, however, we form the vector 



y{t) = [x{t - 1) - x{t - 2), x{t) - x{t - 1)], 



(13) 



6 



<x> o 




FIG. 5: For the M = 3 quantum history-dependent walk, (x) and at time step t — 100 as a function of pnn (solid line) or 
Prl (dashed line) while the other pij are kept constant at 1/2. Varying pll has the opposite effect on {x) and the same on (j x 
as varying prr. Similarly for plr compared to prl- 



where x{t) is the position at time then y{t) forms a discrete time Markov chain between the states 
[—1,-1], [— 1,+1], [+1,-1] and with a transition matrix 

I PL I -PL 

rp ^ PR I - PR 

I- PL PL 

V I- PR PR 

Define tt^ [t] to be the probability of y{t) = [i, j], i,j S {—1, +!}■ A state is now transformed by Ttt at each time step. 
Having represented the history-dependent game as a discrete time Markov chain the standard Markov techniques can 
be applied. The equilibrium distribution is found by solving TtTs — tTs. This yields tTs = [1,1,1, l]/4, giving a process 
with no net bias to the left or right irrespective of the values of and pr. The same analysis holds for M > 2. 
However, interference in the quantum case presents an entirely different picture. 

The comparison with the classical history-dependent Parrondo game requires M = 3. For game A, select the 
unbiased game, pll = Plr = Prl — Prr = 1/2- For game B, choose, for example, prr = 0.55 or plr = 0.6 to 
produce a suitable bias (see Fig. . The operators associated with A and B are applied repeatedly, in some fixed 
sequence, to the state For example, the results of the game sequence AABB after t time steps is 

\m) = {BBAAY''\m)- (15) 

Figure displays {x) for various sequences. Of sequences up to length four, with game B biased by > 0.5 only 
AABB and AAB give a positive expectation, while when game B is biased by p^fl > 0.5 only AAAB is positive. 
These results hold for p up to approximately 0.6, above which there are no positive sequences of length less than or 
equal to four. 

The sequences AABB and BBAA can be considered the same but with different initial states. That is, if instead of 
[■(/lo), we start with If/iQ) = AA\il)o), BBAA gives the same results (displaced by two time steps) as AABB does with 
the original starting state. In the classical case, altering the order of the sequence results in the same trend but with a 
small offset, as one might expect. However, as Fig. El indicates, the change of order in the quantum case can produce 
radically different results. This feature also appears in Meyer and Blumer's quantum Parrondo model. 




VI. CONCLUSION 



A scheme for a discrete quantum random walk with history dependence has been presented. Our system involves 
the use of multiple quantum coins. By suitable selection of the amplitudes for coin flips dependent on certain histories, 
the walk can be biased to give positive or negative {x) . In common with many other properties of quantum random 
walks, the bias results from interference, since the classical equivalent of our random walks are unbiased. With a 
starting state averaged over possible histories, the average spread of probability density in our multi-coin scheme is 
slower than in the single coin case, with the appearance of multiple peaks in the distribution. For even numbers of 
coins there is a substantial probability of a; ~ 0. However, the positions of the outer most peaks are the same as those 





FIG. 6: (Color online) An example of a Parrondo efltect for the AI — 3 history-dependent quantum random walk where game B 
has (top) prh — 0.55 or (bottom) plr = 0.6, with the other pij = 0.5, i,j € {L, R}, while game A has all pij = 0.5 (unbiased). 
The letters next to each curve represent the sequence of games played repeatedly. For example, AB means apply A and then 
B to the state, repeating this sequence 50 times to get to t — 100. 



of a single coin quantum random walk. As the memory effect increases, the dispersion of the quantum walk decreases. 
One may speculate that this feature may be relevant to an understanding of decoherence, here considered as loss of 
coherence within the central portion of the graph around a; sa 0. In particular, the dispersion in the wavefunction 
decreases as we move from a first-order Markov system to a non-first-order Markov system, that is, one with memory. 
This is consistent with the idea that the Markovian approximations tend to over-estimate the decoherence of the 
system. 

Our scheme is the quantum analog of the history-dependent game in a form of Parrondo's paradox. The quantum 
history-dependent walk also exhibits a Parrondo effect, where the disruption of the history dependence in a biased 
walk by mixing with a second, unbiased walk can reverse the bias. In distinction to the classical case, the effect seen 
here is very sensitive to the exact sequence of operations, a quality it shares with other forms of quantum Parrondo's 
games. This sensitivity is consistent with the idea that the effect relies on full coherence over space and in time. 

We have only considered a quantum walk on a line. The effect of memory driven quantum walks on networks with 
different topologies and whether the memory structure can be chosen to optimize the path in such networks, are open 
questions. 
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